MusicCommentator: Generating Comments Synchronized with Musical Audio Signals by a Joint Probabilistic Model of Acoustic and Textual Features
نویسندگان
چکیده
This paper presents a system called MusicCommentator that suggests possible comments on appropriate temporal positions in a musical audio clip. In an online video sharing service, many users can provide free-form text comments for temporal events occurring in clips not for entire clips. To emulate the commenting behavior of users, we propose a joint probabilistic model of audio signals and comments. The system trains the model by using existing clips and users’ comments given to those clips. Given a new clip and some of its comments, the model is used to estimate what temporal positions could be commented on and what comments could be added to those positions. It then concatenates possible words by taking language constraints into account. Our experimental results showed that using existing comments in a new clip resulted in improved accuracy for generating suitable comments to it.
منابع مشابه
Generating the Visual Biofeedback Signals Applicable to Reduction of Wrist Spasticity: A Pilot Study on Stroke Patients
Introduction: Application of biofeedback techniques in rehabilitation has turned into an exciting research area during the recent decade. Providing an appropriate visual or auditory biofeedback signal is the most critical requirement of a biofeedback technique. In this regard, changes in Surface Electromyography (SEMG) signals during wrist movement can be used to generate an indictable visual b...
متن کاملCombining pattern recognition and deep-learning-based algorithms to automatically detect commercial quadcopters using audio signals (Research Article)
Commercial quadcopters with many private, commercial, and public sector applications are a rapidly advancing technology. Currently, there is no guarantee to facilitate the safe operation of these devices in the community. Three different automatic commercial quadcopters identification methods are presented in this paper. Among these three techniques, two are based on deep neural networks in whi...
متن کاملAcoustic correlated sources direction finding in the presence of unknown spatial correlation noise
In this paper, a new method is proposed for DOA estimation of correlated acoustic signals, in the presence of unknown spatial correlation noise. By generating a matrix from the signal subspace with the Hankel-SVD method, the correlated resource information is extracted from each eigen-vector. Then a joint-diagonalization structure is constructed of the signal subspace and basis it, independent...
متن کاملMusical Meter Estimation and Music Transcription
This paper concerns the segmentation and automatic transcription of acoustic musical signals. First, a method is proposed for estimating the temporal structure of music, the musical meter. The method consists of an acoustic analysis front-end and of a subsequent probabilistic model which performs joint estimation of the meter at three time scales: beat (tactus), measure, and tatum pulse levels....
متن کاملMusic Thumbnailer: Visualizing Musical Pieces in Thumbnail Images Based on Acoustic Features
This paper presents a principled method calledMusicThumbnailer to transform musical pieces into visual thumbnail images based on acoustic features extracted from their audio signals. These thumbnails can help users immediately guess the musical contents of audio signals without trial listening. This method is consistent in ways that optimize thumbnails according to the characteristics of a targ...
متن کامل